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ABSTRACT 


Design techniques of linear optimal control are found 
to apply to a minimax problem. With a bounded energy 
constraint on the class of admissible disturbances, the 
minimax value of an integral quadratic form of state 
variables and control can be obtained by finding a positive 
definite steady-state solution of a matrix Riccati equation. 
The optimal strategies for control and disturbance are 
linear functions of state which depend on the numerical 
bound of the class of disturbances, the set of initial 
conditions, and relative weighting of the state variables 
in the cost functional. Analytical design procedures, such 
as the root square locus of Chang, which appear in optimal 
linear control problems are also valid for this problem. 

An equivalent optimal multivariable control problem has 
been found whose steady-state solution is obtained by 
solving the same matrix Riccati equation as was obtained 
from the minimax problem. Sufficient conditions for 
existence of solutions to the minimax problem are thus 
obtained from the properties of the equivalent optimal 
multivariable control problem. The results are illustrated 
by solving a second order example. 
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A WORST DISTURBANCE DESIGN CRITERION IN THE THEORY OP 
ANALYTICAL CONTROL SYSTEMS SYNTHESIS 

By 

Thomas E. Carter 


SUMMARY 


Design techniques of linear optimal control are found 
to apply to a minimax problem. With a bounded energy 
constraint on the class of admissible disturbances, the 
minimax value of an integral quadratic form of state 
variables and control can be obtained by finding a positive 
definite steady-state solution of a matrix Riccati equation. 
The optimal strategies for control and disturbance are 
linear functions of state which depend on the numerical 
bound of the class of disturbances, the set of initial 
conditions, and relative weighting of the state variables 
in the cost functional. Analytical design procedures,, such 
as the root square locus of Chang, which appear in optimal 
linear control problems are also valid for this problem. 

An equivalent optimal multivariable control problem has 
been found whose steady-state solution is obtained by 
solving the same matrix Riccati equation as was obtained 
from the minimax problem. Sufficient conditions for 
existence of solutions to the minimax problem are thus 
obtained from the properties of the equivalent optimal 
multivariable control problem. The results are illustrated 
by solving a second order example. 


I. INTRODUCTION 

LINEAR CONTROL. DIFFERENTIAL GAMES . AND A MINIMAX PROBLEM 

In recent years the mathematical conditions for which 

linear control is optimal have been well defined. 1 In 196l, 

S. S. L. Chang 2 * * S. published a book on optimal control synthesis 
which included a root square locus technique permitting 
mathematically optimum linear systems to be analyzed by the 
well-known root locus diagram. This technique has recently 


been applied to multivariable 3 3 4 control problems to provide 
an analytical approach to control synthesis of high order 
dynamical systems. 

In the above analytical synthesis studies, the problem 
of disturbances was. not considered in the initial design 
phase. It is shown in this work that the same analytical 
synthesis techniques can be applied to a problem with a 
single control and a bounded energy type disturbance. The 
control and disturbance are scalars for this problem, but 
no additional difficulty is encountered, in principle, if 
both are vectors. The problem is formulated as a minimax 
problem and is solved by the theory of differential games. 

For this problem, the control and the disturbance are 
viewed as opposing players in a differential game. The 
solution leads to linear feedback as the optimum strategy 
for both players . Linear control can thus be interpreted 
as the best control for the worst of a well defined class 
of bounded energy disturbances. 

The study of differential games was begun by Isaacs 8 . 

His book 5 is used as a basic reference for much of the 
present work and some of his terminology will be used herein. 
Unfortunately, his terminology is not in agreement with much 
of the usage in optimal control theory. These differences 
are pointed out in Reference 14 . A more rigorous foundation 
for the theory of differential games can be found in the 
work of Berkowitz 9 . Application of differential games to 
problems in optimal control 13 and also to pursuit and evasion 
problems can be found 10 * 1 1 ’ 12 . In Reference 12 the authors 
solve a pursuit-evasion problem which leads to linear feed- 
back strategies for both the pursuer and evader, and the 
results are closely related to those for the linear optimal 
control problem. In the present work a similar relationship 
with the linear optimal control problem exists, but in this 
case, linear "analytical design concepts" are extended to 
include systems subject to worst disturbances. The design 
philosophy presented herein can be used to define a set of 
linear controls, and a corresponding class of worst 
disturbances for which these controls are optimal. 


II. FORMULATION 

The problem is formulated as follows : Consider the 

dynamical system 

x = Ax + bu + cw x(t Q ) = x Q (1.1) 


2 



in which x is a real n vector denoting the state of the 
system, b and c are real constant n vectors, A is a real 
constant nxn matrix, u is a scalar control belonging to 
the class Cp of piecewise continuous functions of time t, 
w is a scalar disturbance belonging to some class W of 
functions of time. The dot denotes differentiation with 
respect to time, and t Q is the initial time. The output 
of the dynamical system is 

y = Hx (1.2) 

where y is a p-dimensional vector and H is a constant pxn 
matrix. The cost functional for this problem is 

T 

J[u,w] = J* [y T Q y + u 2 ]dt + x t (T)Px(T) (1.3) 

to 

where Q is a constant positive definite pXp matrix, P is 
a positive definite constant nxn matrix, and T is the time 
required to attain a terminal surface of dimension n-1 which 
divides the state space into two disjoint n-dimensional 
subsets. (See Reference 5, Chapter 2.) For each admissible 
u(t) and w(t), the solution of (l.l) uniquely determines 
(1.3). The problem consists of finding a control u in C p 
and a disturbance w in W so that 

J[u,w] = min max J[u,w], (1.4) 

ueCp WeW 

The above problem belongs to a class of problems known as 
minimax problems. V. P. Grishin 6 has solved a similar prob- 
lem in which the set W of disturbances is the class of 
piecewise continuous functions of time whose magnitude is 
bounded by a positive constant. We shall consider here the 
class W of admissible disturbances to be the set of piece- 
wise continuous functions of time which satisfy the relation 

T 

J w 2 (t)dt < p 2 (1.5) 

to 

where p is a positive constant. 

In aerospace vehicle control problems, for example, the 
class W of admissible disturbances is a class of winds. The 
relation (1.5) allows a wind in this class to take on 
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arbitrarily large magnitudes, either positive or negative , 
but an average square magnitude is bounded. Admitted in 
this class are large disturbances of short duration (gusts) 
or small disturbances of long duration (breezes). Not 
admitted are large disturbances of long duration (gales). 

If T is infinite, it can be seen that since p is finite, any 
wind in this class must eventually die out. 

The number p 2 can be, for a particular application, 
determined empirically. An estimate can be obtained by 
computing 

T 

j w 2 (t )dt 
to 

for a large number of recorded disturbances and taking the 
largest value of this integral as p 2 . It should be pointed 
out, however, that the worst disturbance which arises from 
a solution of the problem may not resemble any of the 
reocrded disturbances and should be examined for reason- 
ableness. What a solution of the problem does provide is 
the shape of the worst disturbance associated with a given 
dynamical system. 

In order to solve the minimax problem in which the 
disturbance is subject to a bounded integral constraint, 
we shall introduce a positive Lagrange multiplier X and 
consider the new cost functional 

T 

G[u,w] = J [y T Qy + u 2 - \w 2 ]dt + x t (T)Px(T) (1.6) 

to 

in which the disturbance w(t) now belongs to the class Cp 
and the value of X depends on p and x 0 . We shall require 
that the players w and u employ strategies (functions of 
state) rather than time functions. For this reason the 
function w(t) and u(t) will be given by 

w(t) = w[x(t)] 

u(t) = u[x(t)] (1.7) 

where x(t) is the solution of (l.l). The class of 
strategies w(x) and u(x) with the property that w[x(t)] and 
u[x(t ) ] belong to Cp will be denoted Q. In terms of game 
theory our problem is: given x D and p, find strategies u 
and w in Q so that 
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G[u,w] = min max G[u,w]. 

ueO weQ (1.8) 

With the specification of a terminal surface, the 
problem is in a form for which the theory of differential 
games can be applied. We shall restrict our attention to 
terminal surfaces for which we can find a solution having 
stable motion with respect to the origin of the state space. 
This can be accomplished in two ways. 

One way is to choose time as another state variable 
x n+1 and define the terminal surface as the set of points 

for which x n+ ^ = T where T is a fixed terminal tine . Under 

dertain controllability and observability conditions, the 
limit of the minimax value for this problem exists as T 
approaches infinity. It is then shown that this limit is 
a Liapunov function, thus insuring stability. Since this 
approach follows the usual development found in linear 
optimal control 7 , it will not be presented here . 

The other way does not require the concept of a 
Liapunov function. Instead, we choose as a terminal 
surface an appropriate n-1 dimensional ellipsoid which is 
always between the initial state and the origin. Stability 
of motion is assured by shrinking the target ellipsoid so 
that the terminal state becomes arbitrarily near the origin. 
Using this approach, the problem to be solved by application 
of differential game theory is as follows: 

Given the dynamical system (l.l), and the terminal 
surface 

x T Ex - 6 (1.9) 

which is defined by the positive number 6, and the cost 
function (1.6) which depends on 6 and will be denoted 
G§[u,w], find strategies u(x) and w(x) and a positive 
number X so that 

G 6 [u(x),w(x)] = min max G§ [u(x),w(x) ] (1.10) 

ueG weQ 

and the constraint (1.5) Is not violated. 

The quantity Gg[u(x),w(x) ] is, for a particular p and 6, 
a function of x Q . It will be denoted V 5 (x 0 ) and will be 
called the "value" of the game at x 0 . We shall be 
interested in the limit of the value of the game as 6 
approaches zero. 
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III.. SOLUTION OP THE PROBLEM 


There are two computational methods for analyzing, the 
problem. The first method is to solve what Isaacs refers 
to in Reference 5 as the "main equation." This leads to 
the problem of finding a steady-state solution of a matrix - 
Riccati equation. The second method is to solve the "path 
equations" associated with the problem. For our problem 
the path equations lead to a root square locus technique 
similar to that developed by Chang. 

A. SOLUTION VIA THE MAIN EQUATION 

According to the differential games approach, we form 
the X function defined as follows : 

X(x,V x ,u,w) = x T H T QHx + u 2 - Xw 2 + V x (Ax+bu+cw) 

( 2 . 1 ) 

where V x denotes the gradient of a scalar valued function 
of x. For this X function, the "minimax assumption" 

min max X(x,V x ,u,w) = max min X(x,V x ,uw) (2.2) 

u w w u 

is valid since X is the sum of functions of u and w. Since 
X > 0, a necessary and sufficient condition that X he 
minimax is that 


u = 


1 T 

w = ^ V x c > 


(2.3) 


and the main equation is given by 


min maxX(x,V ,u,w) = 0. 
u w A 


(2.4) 


For this problem the main equation becomes 


mm m m 

x H x QHx + V.I Ax - yV'SV = 0 

X XX 


(2.5) 
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( 2 . 6 ) 


T IT 
where S = bb - ycc . 

It Is known from the theory of differential games that 
the value of the game must satisfy the main equation and 
the boundary condition given by the terminal surface. If 
the solution of the main equation satisfying the boundary 
condition is unique, then that solution is the value of the 
game. Since condition (2.3) is necessary and sufficient 
for>C to be minimax, the problem has only one main equation. 
The boundary condition is given by the surface x T Px = 6. 

We then choose P so that V6(x) = xTpx is a solution of the 
main equation. If possible, because such a choice of P will 
provide a terminal value given by 

V6 (x(T) ) = 6. (2.7) 

Assuming a solution of this form gives 

x T H T QHx + 2x T P T Ax - x T P T SPx =0. (2.8) 


If equation (2.8) has a solution which is valid for each x 
in the state space exterior to the region enclosed by the 
terminal set and which satisfies the boundary condition 
(1.9), P must satisfy the matricial equation 

P T A + A T P - P T SP = -h t qh. ( 2.9) 


Let us assume for the moment that A, S, H, and Q 
satisfy whatever conditions are needed in order that a 
unique symmetric positive definite matrix P exists 
satisfying (2.9). It then follows that V§(x) = x T Px is the 
value of the game in which (1.9) is the terminal surface. 

In this case Vs(x) represents the value .at x of a game 
whose terminal surface is an n-dimensional ellipsoid con- 
taining the origin. We are primarily interested in this 
game because taking the limit as 6 approaches zero, the 
terminal state approaches the origin. Recalling that 
V 6 (x) is the value associated with (1.6) and the terminal 
surface (1.9) and that V 6 (x) = 5 on this surface, we 
observe that 


lim V 6 (x) = V(x) (2.10) 

6-0 
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where V(x) is defined as the value associated with (1.6) 
and the terminal state x = 0. 

A result of the above arguments is the following 
theorem: If P is a unique positive definite solution of 

(2.9), then the minimax value of (1.6) for the terminal 
surface (1.9) is given by V(x) = x™Px, and the strategies 
(2.3) are optimal for any 6 > 0; the motion of (l.l) for 
these strategies is stable with respect to the origin. 

Since V x = 2Px, we can now write explicitly the 
expressions for the "best" control and the "worst" wind. 
These are 

u = — b^Px (2.11) 

w = |c T Px. (2.12) 


The optimal strategy for both players is linear. 

Given A, the optimal play depends on Q, H, b, e, and X. 
These characteristics uniquely define the optimal feedback 
strategy for control. In previous linear theory in which 
the disturbance was assumed zero, the optimal feedback was 
of the same form, but depended only on Q, H, and b. Note 
that the more general minimax control reduces to the zero 
disturbance optimal linear control as X becomes infinite. 
This is seen from equations (2.6), (2.9)* and (2.12). 

B. CALCULATION OP THE ELLIPSOID .OF' INITIAL STATES 

The optimal strategies (2.11) and (2.12) depend on X, 
which, in turn, depends on p and the initial conditions by 
(1.5) and (2.12). As the problem has been formulated x Q 
and p are_assumed fixed, and we solve for X and strategies 
u(x) and w(x) for which the minimax value of (1.3) is 
attained. Prom the standpoint of design, however, it may 
be advantageous to specify X and work backward to find the 
set of all initial states for which the strategies are 
optimal. (Note also that X is a convenient parameter for 
representing the combined effects of p and x Q , and it will 
be used in this manner in the work to follow. ) 

If X is specified so that there exists a unique 
positive definite solution of (2.9), then by using the 
strategies (2.11) and (2.12), the differential system (l.l) 
becomes, in closed loop form. 
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x = Ax 


x (t Q ) = x o 


(2.13) 


where A = A - SP ( 2 . 14 ) 

and the initial state x D belongs to a set for which (1.5) is 
satisfied where the disturbance is given by (2.12). 

Let us define a function W of initial state by 
T 

W(x 0 ) = J w 2 (t)dt. ( 2 . 15 ) 

to 

Since w^t) is nonnegative, W(x G ) is at least positive semi- 
definite. Its time derivative along solutions of (2.I3) is 
given by 


W(x(t)) = - ^ T (t)P T <=° T ^(t) 


( 2 . 16 ) 


For this reason, it is apparent that W(x D ) is a 
quadratic form 


W(x ) = x T Bx . 

' O ' 7 o o’ 


(2.17) 


if the nxn matrix B satisfies the linear equation 


K, *sJP 

BA + A B = 


P T CC T P 


( 2 . 18 ) 


The matrix B is the entity that relates p, and x 0 . 
It is obtained from \ and P by solving (2.18). From (1.5), 
( 2 . 15 ), and (2.17), the initial states for which strategies 
(2.1l) and (2.12) are optimal for a particular \ are 
contained in the region 


*>0 5 p! 


( 2 . 19 ) 


If B is positive definite, the geometric representation of 
( 2 . 19 ) is the set of points on and interior to the n-1 
dimensional ellipsoid 
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( 2 . 20 ) 


x T Bx = p 2 . 


The value of X from which the region (2.19) is 
determined defines the best control given by (2.11) for the 
worst disturbance in the class W and for the worst initial 
state in the region (2.19). For initial states exterior 
to this region, another value of X is needed in order to 
define the optimal strategies. 

C. SOLUTION VIA THE PATH EQUATIONS 

Equations (2.11 - 2.14) provide a means of computing 
the optimal strategies and resulting motion of the differ- 
ential system. In order to perform these computations, 
however, a positive definite solution of the matricial 
equation (2.9) must be found. A root locus analysis, for 
example, would require finding a steady-state solution of 
a matrix Ricatti equation for each new value of X or of the 
elements of Q in order to find the eigenvalues of A from ^ 
(2.14). It is possible, however, to find eigenvalues of A 
without directly solving (2.9). This is done by a root 
square locus method which can be developed from the path 
equations presented in Chapter 4 of Reference 5. 

The path equations can be written in the form 

V x (x) = -^.(x^^w) (2.21) 


where X (x,V x ,u,w) is given by (2.1). The subscripts denote 
gradients with respect to x; u and w are given by (2.3)# 
and V(x) solves the main equation. 

Equation (2.21) presents an expression for the time 
rate of change of the gradient of the value of the game 
along solution trajectories of the differential system. 

The differential system (l.l) for the optimal strategies 
(2.3) becomes 

x = Ax — ^SV X . (2.22) 


From equations (2.1) and (2.21) the path equations become 

V x = -2H T QHx - V x T A. (2.23) 
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Equations (2.22) and (2.23) can be thought of as a 
system of 2n first order differential equations in terms of 
unknowns V Xj and x. (j = l,...,n). Written in this manner 


c j 


the path equations and differential system can be expressed 
as follows : 


■“ — 

\ 

X 


A - is 


X 

s - 

= 

-2H T QH - A T 


. Vx _ 


(2.24) 


The characteristic equation of this system is given by 


A - si 
-2H T QJi 



T 

-A 1 -Si 


= 0 . 


(2.25) 


where I denotes the nXn identity matrix. The root square 
locus is obtained from the roots of this equation and will 
be shown in the next section to be equivalent under certain 
conditions to a multivariable root square locus of an undisturbed 
optimal multichannel control system 3 3 4 . 

If a positive definite solution of the matricial 
equation (2.9) exists, then n of the 2n roots of (2.25) are 
in the left half plane, and these stable roots are the 
eigenvalues of A, which is given by (2.13). Sufficient 
conditions for existence of a positive definite solution of 
(2.9) are presented in the section following. 

D. AN EQUIVALENT OPTIMAL MULTIVARIABLE CONTROL PROBLEM 

Minimax and optimal control problems are solved by 
similar methods. It will be demonstrated that the minimax 
problem considered here can be reduced to an optimal 
control problem with several control variables . The two 
problems are equivalent in the sense that both have the 
same terminal conditions and both lead to the same Riccati 
equation. A solution of one problem leads immediately to 
a solution of the other. 

The only condition we shall need in order to demonstrate 
the existence of an equivalent optimal control problem is 
the requirement that the matrix S given by (2.6) be positive 
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semi -definite . This condition places a restriction on X 
which confines the class of admissible disturbances so that 
controllability is possible. We use a generalized definition 
of controllability here which is relative to the class of 
admissible disturbances.* The plant is said to be completely 
controllable relative to the class W if for each disturbance 
in W there exists a finite control capable of bringing the 
motion from any initial state to any desired state in finite 
time. This generalized controllability for a system with 
disturbances as (l.l) can be shown to be the same as control- 
lability in the usual sense for a certain multivariable 
control system with no disturbance if a certain matrix 
exists. This is seen as follows. 

Suppose there exists an nXr matrix F where r<n which 
has the property that for each admissible u(t) and w(t) 
there is a finite piecewise continuous r-vector function 
v(t) satisfying the equation 

Fv(t)=bu(t)+cw(t) (2.26) 

and also b has the property that for each such v(t) and 
each w(t) in W there is an admissible u(t) such that 
equation (2.26) is satisfied. Under these conditions for 
every motion of (l.l) under a given disturbance and control, 
there is an identical motion of the multi-channel system 

x = Ax + Fv (2.27) 

for some v(t) and conversely. It is seen then that the 
disturbed plant is completely controllable in the general- 
ized sense relative to W if and only if the multi-channel 
controlled plant is completely controllable in the usual 
sense. With this motivation we shall analyze the differ- 
ential game by analysis of an equivalent optimal control 
problem whose plant equations are in the form of (2.27). 

A well known property of a positive semi-definite matrix 
is that it can be written as the product of a rectangular 
matrix and its transpose. Since S is positive semi -definite 
there exists an nxr matrix F having the property that 

FF T = S (2.28) 


* Compare with the relative controllability concept in the 
"Linear Pursuit-Evasion Game" of Ho, Bryson, and Baron 2 . 
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where r is the rank of S. This matrix P is used to define 
the plant equations (2.27). The performance index of the 
multi-channel optimal control problem is given by 

T 

G[v] * J* [y T Qy + v T Iv]dt + x T (T)Px(T) (2.29) 

to 

where I is the rxr identity matrix, y is given by (1.2), 
and the terminal set is exactly the same as for the minimax 
problem. 

Solving the Hamilton- Jacobi equation for this problem, 
a minimum of G[v] is given by V = xTpx where P is a solution 
of the steady state matrix Riccati equation 

P T A + A T P - PFI -1 F T P + H T QH = 0 (2.30) 

and the optimal control law is given by 

v = -iF T Px. (2.31) 

We see from (2.28) that (2. 30) is exactly the same equation 
as (2.9); hence, the minimum cost of (2.29) is exactly the 
same as the minimax value of (1.6) since the terminal set 
is the same in both problems. Furthermore, sufficient 
conditions for existence of a unique positive definite 
solution of (2.30) have been developed by Kalman 7 . These 
are that the pair [A,F] is completely controllable and the 
pair [ A,H] is completely observable. A unique positive 
definite solution of (2.9) is sufficient to insure existence 
and uniqueness of the solution of the optimal control 
problem and asymptotic stability of the motion. Since the 
same can be said of the minimax problem, the function 

V(x) = x T Px may be interpreted either as the minimum cost 
of (2.29) or as the minimax value of (1.6). 

IV,. A SECOND ORDER EXAMPLE 

The application of the preceding theory to a worst 
disturbance design problem is illustrated by solving a 
second order example. Higher order problems can be solved 
by this theory but the complexity of the numerical analysis 
will, in most cases, require a computer. The sample problem 
is as follows. 
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Given the second order dynamical system* 


“ - 


“ 


- 


- 


- 

Xi 


0 1 


Xx 


0 


0 


= 




+ 


u+ 


- 


1 

P 

O 

1 


_ Xa _ 


-b_ 


c 


and the cost functional 

T 


w 


(3.1) 


G[u,w] 



[q x x? + q 3 xl + u 2 


- \w 2 ]dt 


+ x T (T)Px(T) 


(3.2) 


where x 1 , x s , a, h, c, q x , q 3 , and X are scalars the last 
three being non -negative, and the terminal set is 


lim {x | x T Px = 6 T , (3.3) 

6-0 

find the optimal strategies so that (3.2) is minimax. 

Before solving this problem we shall examine it for 
existence of unique stable solutions. For this problem 
expression (2.6) becomes 


where 



0 

A 


A 



(3.4) 


(3.5) 


* A physical model leading to this equation is the rotational 
equation of a typical rocket in which the lateral drift is 
neglected in . the angle -of -attack expression. The rotational 
equation is *<J> + c x or + c 3 P = 0 where a = cp + o' w . In this 
model cp represents the vehicle attitude angle, a the angle 
of attack, P the engine thrust angle, or w the angle of attack 
due to wind disturbance, and c x and c 3 are the normalized 
rotational acceleration coefficients associated with 
aerodynamic and thrust forces. 
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Necessary and sufficient for S to be positive semi-definite 
is the condition 

b 2 - y ~ > 0. (3.6) 

Noting that the rank of S is at most one, we find that 
the two solutions of (2.28) are given by 



0 


0 

F, = 

_+ vr 

3 p3 = 

- - 


(3.7) 


Each of these matrices defines an equivalent optimal control 
problem of the form given by (2.27). One of these equivalent 
optimal control problems has its plant equations given by 


Xi 


0 1 


— «• 

Xi 


— *■ 

0 


= 




+ 


XjS 


a 0 


X 2 


VT 


v. 


(3.8) 


and its cost function is 

T 

G[v] = J [ qi Xi + q s x| + v 2 ]dt + X T (T)Px(T) (3-9) 
t o 


where for this case the control v is a scalar. 

Forming the controllability matrix [F,AF] we see that 
for either of the two solutions of (2.28), its rank is two 
if and only if A £ 0; hence, [A,F] is controllable if and 
only if 


\ > — and b 0. 
b 2 


( 3 . 10 ) 


Let us choose Q = I which is clearly positive definite, and 
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0 


H - 



0 


WqaJ 


(3.11) 


T T T 

Forming the observability matrix [H , A H ] we find its 
rank is two if a = 0 and q x and q s are non-negative, but 
not both zero. If a=0, the rank is two only if q x is 
positive. The observability condition that the rank is 
two, along with the controllability condition (3. 10) is 
sufficient for the existence of a unique stable solution of 
the problem. 

After this examination, we shall solve the problem. 

Due to the simplicity of this problem, we shall solve the 
main equation, directly rather than taking the alternate 
route via the path equations. By forming either the main 
equation of the differential game or the Hamilton-Jacobi 
equation of. an equivalent optimal control problem and 
assuming a solution in quadratic form we obtain the 
matricial equation (2.9). Of the two solutions of this 
equation the requirement of positive definiteness excludes 
one, and the remaining one is given by 


P 


r/2-(a+r)+Aq 3 


A 


a+r 


a+r 


A 

V2(a+r)+Aq s 


A 


A 


(3.12) 


where 


r = Va 2 + Aq x 


(3.13) 


It Is seen from (3. 12) and (3. 13) that a positive definite 
solution exists if A>0 and the non-negative numbers q x and 
q a are not both zero. If, however, a=0, it is required 
that q x >0. These conditions for a solution given by (3.12) 
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to be positive definite are exactly the same as those 
determined by the controllability and observability exami- 
nation before the solutions of the matricial equation were 
found. 

Knowing P in terms of X from equations (3.5), (3-12) 
and ( 3 - 13 ) the o’ptimal strategies are given as functions of 
X by (2.11) and (2.12), and the motion is given by (2.13) 
and (2.14). For this problem, equation (2.14) becomes 


0 


A = 


-r 


1 

-V2(a+r)+Aq 2 


(3.14) 


Because of positive definiteness of P, A is a stable matrix. 

The eigenvalues of A are presented in Figures 1 and 2 
with q x , q 3 , and A as variable gains. Figure 1 shows the 
root locus pattern of the disturbed system with Aq x 
increasing where the ratio 

Ml. 

Aq 2 

assumes fixed values. These loci are, in actuality, the 
stable half of the root square locus diagram we would have 
obtained if the problem had been solved via the path 
equations . 

We can now specify a desired natural frequency and 
damping ratio of the disturbed system and determine from 
these corresponding values of Aq x and Aq 2 . Since we have 
a second order system, the expressions for Aq x and Aq 2 are 


Mi - «£ - a 2 , Aqs = 4c 2 u£ - 2 (a+u£). (3.15) 

These expressions show the relationship between q x , q 2 , and 
A which provides the desired point on the root locus. 

Since A depends on X, which in turn depends on x Q and p, we 
have a way of picking the weighting factors q x and q 3 in 
terms of desired frequency and damping, the initial state, 
and the class of admissible disturbances which is defined by 
p. Figure 2 shows a locus of roots as A varies for fixed 
qi and q 2 . 
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For this second order system, we can compute an "ellipse 
of initial states" in terms of the natural frequency and 
damping ratio. Equation (2.20) for the second order system 
becomes 


fruXi 2 + 2b 12 XiX S + basx 2 s = p 2 (3.16) 


where bn, bx 2 , and baa are the elements of the matrix B 
which is obtained by solving equation (2.18). For this 
problem those elements are given in terms of natural fre- 
quency w n , damping ratio C, and \ as follows: 


bi i — 


( a +<% 2 ) 2 + 4 C s a 2 

40 n 


bi a = 


(a+V 5 ) 2 


2ou. 


n 


(3.17) 


bi 3 = m* 


( a +^ n 3 ) 2 + i + ^ 2 u ) n 4 


where 


M- = 


Xb 2 - c 2 


(3.18) 


The equations (3.16), (3. 17), and (3.18) provide a 
relationship between the initial state, the class of distur- 
bances, and the multiplier X. A sketch of equation (3.16) 

for C = .866 and u> n = 4V a is presented in Figure 3« 
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For this problem the worst disturbance is given by 

w(t) = p. [ ( a+u> n 2 ) Xx(t) + 2£cu n xa(t)3. (3.19) 



The shape of the worst disturbance is presented in Figure 4 
for the above values of G and u> n and the initial condition 

Xi (t Q ) = xio,x 3 (t 0 ) = 0. 


IV. CONCLUSION 


It has been found that the analytical design techniques 
of linear optimal control can be extended to apply to a 
minimax problem in which the energy of disturbance is bounded. 
The main equation for this problem corresponds to the 
Hamilton-Jacobi equation of a class of equivalent optimal 
multivariable control problems. A certain quadratic form was 
found to provide a relationship between the class of admissible 
disturbances and the set of Initial conditions. Solution of 
the problem yields a linear feedback control law which mini- 
mizes a performance index subject to the disturbance which 
maximizes it. For a given plant, therefore, the class of 
admissible disturbances for which linear control Is optimal, 
and the shape of the worst disturbance in the class, are well 
defined. 

Knowing the worst disturbance for which linear control 
is optimal, the following observation becomes apparent. The 
shape of the worst disturbance depends on the plant dynamics 
in a very simple manner. Since the disturbance is a linear 
combination of state variables, the frequencies of the 
oscillation of the worst disturbance are the same as the 
closed loop oscillations of the plant. A structural bending 
mode, for example. In a boost vehicle would cause the worst 
disturbance for this particular model to have an oscillatory 
component at exactly the same frequency as the bending 
vibration. 

For this reason, a worst disturbance design criterion 
might be expected to be over-conservative. The philosophy 
that nature is totally against you is, hopefully, unrealistic. 
It might, however, provide better control than a theory 
which ignores disturbance effects altogether, as much linear 
optimum control theory does. The question, from a practical 
standpoint, is as follows. 

Does a worst disturbance design criterion provide a 
good control system for a less "hostile," more reasonable 
class of disturbances? 

This question should be investigated. 
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FIG. 1 ROOT LOCUS OF SECOND ORDER MINIMAX PROBLEM: 
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IPSE OF INITIAL STATES: 
.866, a» R = 4 /cT 




APPROVAL 


A WORST DISTURBANCE DESIGN CRITERION IN THE THEORY OF 
ANALYTICAL CONTROL SYSTEMS SYNTHESIS 

By 

Thomas E. Carter 


The information in this report has been reviewed for 
security classification. Review of any information con- 
cerning Department of Defense or Atomic Energy Commission 
programs has been made by the MSFC Security Classification 
Officer. This report, in its entirety, has been determined 
to be unclassified. 

This report has also been reviewed and approved for 
technical accuracy. 





JAMES C. BLAIR 

Cmef, Optimization Theory Branch 




'CLYDE D. BAKER (/Chief 

Astijodynamics & Guidance Theory Division 



E. D. GEISSLER, Director 
Aero-Astrodynamics Laboratory 


24 



DISTRIBUTION 


TM X-53473 


DIR 

Dr . von Braun 

R-DIR 

Dr. McCall 

R-RP 

Mr. Bucher 
R-ASTR 

Dr. Haeussermann 
Mr. Hosenthien 
Mr. Moore 
Mr. Schultz 
Mr. Borelli 
Mr. Mack 
Mr. Horton 

R-COMP 

Dr. Arenstorf 


MS-IL (8) 

MS-IP 

MS-H 

I-RM-M 

PP-P 

MS-T (6) 

DEP-T 

Scientific & Technical 

Information Facility (25) 
ATTN: NASA Representative 

(S-AK/RKT) 

P. 0. Box 33 
College Park, Maryland 

Mr. Carl Janow 
Code REC 

Control & Stabilization Branch 
National Aeronautics & Space 
Administration 
Washington, D. C. 


R-AERO 

Dr. Steve Hu 

Dr. Geissler 

Northrop Corporation 

Mr. Jean 

Box 1484 

Mr. Horn 

Mr. Rheinfurth 

Huntsville, Alabama 

Mr. Lewis 

Dr. George Leitmann 

Mr. Blair 

Associate Professor 

Mr. Redus 

Engineering Science 

Mr . Cummings 

University of California 

Mr . Ryan 

Berkeley, California 

Mr. Townsend 


Mr. Baker 

Dr. Bernard Friedland 

Mr. Mowery 

Staff Scientist - Control 

Mr . Vaughan 

General Precision, Inc. 

Mr. Thomae 

Research Center 

Mr. Hart 
Mr. Dearman 

Little Falls, New Jersey 

Mr. Schwaniger 

Dr. C. T. Leondes 

Mr. Lovingood 

Department of Electrical 

Mr. Davis 

Engineering 

Dr. Sperling 

University of California 

Mr. Carter (8) 

Los Angeles, California 


25 


DISTRIBUTION 


Mr. Marlin Sloan 
Northrop Space Laboratories 
Box 1484 

Huntsville, Alabama 

Mr. Gary P. Herring 
Chrysler Corporation 
HIC Building 
Huntsville, Alabama 

Dr. A. E. Bryson, Head 
Mechanical Engineering Dept. 
Harvard University 
Cambridge, Massachusetts 

Dr. C. D. Johnson 
University of Alabama 
Research Center 
301 Sparkman Drive 
Huntsville, Alabama 

Dr. Arthur Bennett 
Boeing Company 
Mail Stop AK-39 
Huntsville, Alabama 

Dr. Robert Bass 
Research Institute for 
Advanced Study 
7212- Bellona Avenue 
Baltimore 12, Maryland 


Dr. C. A. Harvey 
Military Products Group 
Research Laboratory 
Honeywell, Inc. 

2345 Walnut Street 

St. Paul, Minnesota 55113 

Dr. E. G. Rynaski 

Plight Research Department 

Cornell Aeronautical Laboratory 

P. 0. Box 235 

Buffalo, New York 14221 

Dr. Y. C. Ho 

Mechanical Engineering Dept. 

Harvard University 
Cambridge, Massachusetts 

Dr. S. Baron 

Mechanical Engineering Dept. 

Harvard University 
Cambridge, Massachusetts 

Dr. Isaac Kliger 

Lockheed Missile & Space Laboratory 
4800 Bradford Drive 
Huntsville, Alabama 

Dr. C. P. Chen 
Brown Engineering Company 
300 Sparkman Drive, N. W. 
Huntsville, Alabama 


Mr. Gordon Christopher 
Manager, Dynamics & Guidance 
Lockheed Missiles & Space Co. 
4800 Bradford Drive 
Huntsville, Alabama 


Dr. Rudolph Kalman 
Research Institute for 
Advanced Study 
7212 Bellona Avenue 
Balt imo re , Mary 1 and 


Dr. Henry Hermes 

Assistant Professor 

Division of Applied Mathematics 

Brown University 

Providence, Rhode Island 


26 



DISTRIBUTION 


Dr. Eugene Sevin 
IIT Research Center 
10 W. 35th Street 
Chicago, Illinois 

Dr. Robert Webber 
Hughes Aircraft Company 
Bldg. 117, Mail Station 46 
P. 0. Box 90919 
Los Angeles, California 

Mr. J. R. Elliott 
SMD, Mail Stop 304 
NASA, Langley Research Center 
Langley Station 
Hampton, Virginia 23365 

Dr. Stephen J. Kahne 
Department of Electrical 
Engineering 

University of Minnesota 
Minneapolis, Minn. 55455 

NASA, Ames Research Center 
Moffett Field, California 94035 
ATTN: Librarian 

NASA, Electronics Research Center 
575 Technology Square 
Cambridge, Massachusetts 02139 
ATTN: Librarian 

NASA, Goddard Space Flight Center 
Greenbelt Maryland 20771 
ATTN : Librarian 

NASA, Kennedy Space Center 
Kennedy Space Center, Florida 32899 
ATTN: Librarian 

NASA, Lewis Research Center 
21000 Brookpark Road 
Cleveland, Ohio 44135 
ATTN : Librarian 


NASA, Manned Spacecraft Center 
Houston, Texas 77058 
ATTN : Librarian 

Jet Propulsion Laboratory 
4800 Oak Drive Drive 
Pasadena, California 91103 
ATTN : Librarian 

NASA, Langley Research Center 
Langley Station 
Hampton, Virginia 23365 

Dr. Bernard H. Paiewonsky 
Aeronautical Research Associates 
of Princeton 
Princeton, New Jersey 

Dr. Rufus Isaacs 
Center for Naval Analysis 
1401 Wilson Blvd. 

Arlington, Virginia 


27 



